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ABSTRACT 

A review of existing accountability processes and 
reports of the Florida State University System, the State Community 
College System, and public and independent postsecondary institutions 
was conducted in compliance with a 1994 Florida legislative mandate. 
The review centered on priority areas identified in the 1993 Master 
Plan for Florida Postsecondary Education which were quality of 
undergraduate education, productivity, and access/diversity. Eleven 
recommendations were made concerning issues of accountability 
repo.rting: (1) site visits to a sample of public institutions; (2) 
inclusion in accountability reports of alternatives to the College 
Level Academic Skills Test by community colleges; (3) reporting of 
instructional productivity by state universities using faculty 
contact hours by rank; (4) reporting of time-to-degree and credit 
hours taken beyond degree requirements; (5) phasing in of required 
measures; (6) identification of nonreporting institutions in order to 
encourage compliance in accountability reporting; (7) inclusion of 
the Limited Access Competitive Grant Program in accountability 
reports; (8) response to multiple accountability-related initiatives; 
(9) integration of performance-based budgeting and statutory 
accountability reporting; (10) presentation of reports in an 
accessible and understandable format; and (11) establishment of 
system goals. Seven appendices provide additional supporting 
documentation such as accountability reporting requirements, 
statutory references for accountability, and sample indicators of 
quality in undergraduate education. (DB) 



A jV * * Vc Vc A * A Vc A * * A A Vt A 5't j'c Vc A >'{ jV 5't jV * * jWt * j’cjV jV jV Vc 5'c Vc jWt * * jWc * * jWt jV Vc jV * jV jV A * jV jWt * jV* * * * * * * * * * * 

* Reproductions supplied by EDRS are the best that can be made * 

from the original docutnent. * 

Vlf Vlf * iatic * :V * Vlf iV it it it it it it it it it it it it it it it it it it it it it iticititit it it it it it it it it it it it it it it it it it it it it it it it it 



ED 393 382 











PEPC 




POSTSECONDARY ACCOUNTABILITY 

REVIEW 










N 



Report and Recommendations of the 
Florida Postsecondary Education Plan " ’ng Commission 



o 

ERIC 



U t. OCPARTMINT COUCATtON 

OMc* at E<3ocitK>o4i RtMtrcB iftd impKW^mtnt 

EDUCATtONAL RESOURCES INFORMAHON 
CENTER (ER'O 

n This (Jocufi'^nl h®t bttn r#orodiicA<) •• 
f«ce<vtd trom th« p«r*on 0» Of*tni*«tO« 

OngiHttihQ it 

O Minor chtngtt htvt !)••« «•<»• to i«p»Ov« 
riproduction quality 



• Point* Of viqyr O* OprorOfi* »t*t*(J »n thi* JtCu- 
m#nt do not 
OERI potiDOn or POhcy 



-PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

F lorida Postsecondary 
Education Planning Com 

TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC).“ 



December 1995 

2 



DCCT nnnv susu uu c 



POSTSECONDARY EDUCATION PLANNING COMMISSION 



H. Clyde Hobby, Chairman Sally 1. Gillespie Earl E. Olden 

New Port Richey New Smyrna Beach Tallahassee 



Richard C. Alterman 

Opa Locka 

Inez W. Bailey 

Niceville 

Ivie R. Burch 

Panama City 



Thomas J. Haynes 

Tallahassee 

James E. Kirk, Jr. 

Ocala 

Robert B. Mautz 

Gainesville 



Karen L. Plunkett 

Orlando 

Edgar E. Tolle 

Crystal River 

Mark K. Wheeler 

St. Augustine 



William B. Proctor, Executive Director 



The Postsecondary Education Planning Commission, initially created by executive order in 1980, given statutory 
authority in 1981 (SS 240.145 and 240.147, Florida Statutes), and reauthorized by the 1991 Legislature, serves as a 
citizen board to coordinate the efforts of postsecondary institutions and provide independent policy analyses and rec- 
ommendations to the State Board of Education and the Legislature. The Commission is composed of 1 1 members of 
the general public and one full-time student registered at a postsecondary education institution in Florida. Members 
are appointed by the Governor with the approval of three members of the State Board of Education and subject to 
confirmation by the Senate. 

The major responsibility of the Commission is preparing and updating every five years a master plan for postsecondary 
education. The enabling legislation provides that the Plan “shall include consideration of the promotion of quality, 
fundamental educational go«.. s, programmatic access, needs for remedial education, regional and state economic de- 
velopment, international education programs, demographic patterns, student demand for programs, needs of particular 
subgroups of the population, implementation of innovative educational techniques and technology, and the require- 
ments of the labor market. The capacity of existing programs, in both public and independent institutions, to respond 
to identified needs shall be evaluated and a plan shall be developed to respond efficiently to unmet needs.” 

Other responsibilities include recommending to the State Board of Education program contracts with independent 
institutions; advising the State Board regarding the need for and location of new programs, branch campulies and 
centers of public postsecondary education institutions; periodically reviewing the accountability processes and reports 
of the public and independent postsecondary sectors; reviewing public postsecondary education budget requests for 
compliance with the State Master Plan; and periodically conducting special studies, analyses, and evaluations related 
to specific postsecondary education issues and programs. 

Further information about the Commission, its publications, meetings and other activities may be obtained from the 
Commission office, 224 Collins Building, Department of Education, Tallahassee, Florida, 32399-0400; telephone 
(904) 488-7894; FAX (904) 922-5388. 
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In 1994, the Florida Legislature revised the Commission’s statutory authority 
with regard to accountability, directing the Commission to: 

Periodically review the design and implementation of the ac- 
countability processes and reports of the State University Sys- 
tem, State Community College System, and public and inde- 
pendent postsecondary institutions. At least every 5 years, 
evaluate the extent to which each plan is contributing to the 
achievement of state goals for postsecondary education and 
report to the State Board of Education, the President of the 
Senate, and the Speaker of the House of Representatives with 
recommendations on any changes needed in the accountabil- 
ity process or plans. (Section 240.147, Florida Statutes) 

Additionally, proviso language accompanying Specific Appropriation 198 of 
the 1995 General Appropriations Act directed the Commission to continue its 
accountability review, assessing the degree to which institutional and system 
goals relate to state priorities. 

In Challenges, Realities, Strategies: The Master Plan for Florida Postsec- 
ondary Education for the 21st Century (1993), the Commission endorsed 
targeting a few priorities as a strategy for dealing with the fiscal realities that 
constrain accountability expectations. After a review of all current postsec- 
ondary master plan? in Florida and the strategic plans of the Department of 
Education and the Office of the Governor, the Commission identified three 
themes which cut across postsecondary sectors: quality of undergraduate edu- 
cation, productivity, and access/diversity. These priority areas provide the 
focus for the Commission’s review. 

The Commission’s review process follows a two-tier approach. Annual re- 
views over four years focus on the design and implementation of the account- 
ability processes and reports of both public systems. For purposes of the re- 
view, the 1994 system and institutional accountability plans and reports are 
the primary resource documents. Annual review questions examine the rela- 
tionship between accountability and continual improvement in a sample of 
state universities and community colleges diverse in size, mission, and loca- 
tion. A secondary purpose of the annual review is to report current public and 
independent sector performance on key indicators related to the statewide ac- 
countability priorities. A fifth-year summative review to be conducted in 1 999 
will assess system-wide progress with regard to the state priority areas. 

In its two previous reports on accountability, the Commission espoused that 
accountability serves dual purposes — to aid in institutional improvement and 
to provide the Legislature and the public with information about system 
progress in addressing statewide priorities. The community colleges have 
allowed for these dual purposes of accountability by providing ftvo sections in 
each institutional accountability report: a section to report data related to the 
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measures in statute and a supplemental section that allows institutions to re- 
port goals, activities, and data related to institution-specific measures. One of 
the purposes stated in the Community College System 1994 Accountability 
Plan is “the establishment of a viable process that allows the institutions to 
assess and improve their quality and effectiveness.” From the institutional 
accountability documents reviewed, the Commission believes the community 
colleges to be achieving that purpose. In contrast to the State Board of Com- 
munity Colleges, the Board of Regents no longer requires institutions to sub- 
mit an annual accountability plan. In the future, individual universities will 
not submit separate accountability reports, but will provide data for the 
systemwide report. It was not possible from a review of documents, there- 
fore, to assess the degree to which universities are using accountability for 
institutional improvement. This will be the focus of accountability-related 
site visits to a sample of universities and community colleges in future years. 



Issues and The Commission identified several issues in conjunction with this study and 
Recommendations made recommendations intended to improve the accountability process. Cer- 
tain issues that affect each postsecondary sector individually are followed by 
accountability issues that cut across sector lines. 

Commission *s Issue: Site Visits 

Review Method „ , . 

Recommendation: 

1. The Commission should supplement future analyses of an annual 
sample of public institution accountability plans, processes, and re- 
ports with site visits to the universities in each sample and two com- 
munity colleges, in order to further assess their use of the account- 
ability process for institutional improvement. 



Community Colleges Issue: CLAST Alternatives 

Recommendation: 

2. As alternatives to the CLAST are developed pursuant to CS/HB 821, 

the Community College System should develop accountability mea- 
sures that supplement student CLAST pass rates with the number 
and percentage of students exempting the CLAST via each alterna- 
tive. 



State Universities Issue: Reporting of Instructional Productivity 

Recommendation : 

3. State University System data with regard to instructional contact 
hours should be reported in a manner that allows for an analysis of 
faculty instructional activities by rank across lower undergraduate, 
upper undergraduate, and graduate levels. 

O 

ERIC 



7 



Postsecondary Accountability Review 



iU 



Issue: Time-to-Degree Repordng 

Recommendation: 

4. State University System accountability reporting with regard to time 
to degree should include, by institution, the average number of credit 
hours taken beyond degree requirements. 

Independent 
Institutions 

5. Beginning with its 1994-95 Accountability Report, the ICUF insti- 
tutions should include data on all indicators that were optional in 
1993-94 while data collection on a common student cohort was be- 
ing phased in. 

Issue: Institution-Level Data 

Recommendation: 

6. ICUF should continue to seek full institutional participation in ac- 
countability reporting. To aid in interpretation of reported data, any 
non-reporting institutions should be listed with each indicator. In- 
dividual institutional data should appear in appendices of the ICUF 
Accountability Report 



Issue: Phasing in of Measures 
Recommendation: 



Issue: Limited Access Competitive Grant Program 
Recommendation: 



7. Future ICUF Accountability Reports should contain data for the 
accountability measures in Appendix E related to the Limited Ac- 
cess Competitive Grant Program. 



Issue: _ResD.ondin 2 to Multiple Accountability-Related Initiatives 
Recommendation: 



Accountability Issues 
That Cross Sectors 



8. Section 240.214 (1), Florida Statutes, should be revised to read The 
annual accountability report shall include goals and measurable ob- 
jectives related to the system-wide strategic mas te r plan pursuant to 
s. 240.209. The report pkm must include, at a minimum, system- 
wide performance targets, measures, and data o bjecti v es related to 
the following issues measur e s : 

(a) Undereraduate teaching productivity and class size: T ota l stu - 
d e n t c r edit hours; 

0>) Access and diversity: Tot a l numb e r of cont a ct hours of inst ru c t 
turn - pr odu ced by faculty, by instit u iion, ra n k, and cou rs e le ve l; 
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(c) Baccalaureate degree retention and graduation: P a ss rat e s t m 
prof e ssionaHi cen sur e examinations, by insti t uti o n; 

(d) Progression to the baccalaureate degree: InsHt ut io n al gual it v as 
asse s sed by f o lhwi t p, s u c h as an a lyses of employment inf o rmation 
on forme r s tu de n t s , nati o nal rankings, and surv e ys of alumni, par - 
ents, client s , and e m ployers; 

(e) Research: Leng t h of time and nu m be r o f academic credits re - 
quired -to c omple te an academi c degree, by institution and by rfg- 
greet 

(f) Public service: and En r oll m ent, progression, retention, and 
gr a d u a t io n r ates by r a c e and ge n der; 

(g) Institutional quality. S tu dent c o urse demand: 

fhl An analysis of administ ra ti ve and supp o r t j un c t ions; 

Every 3 years, beginning 199S-96;an analy s is of the cumulative 
debt of Student s ; and 

^ An ev a lua t ion of the pr o duction of classr o om co ntact hours at 
each university in c o mparison to a s ta ndard of 12 c o ntac t hours per 
t e rm or 32 c o ntac t hours per year f o r e a ch fulhtime inst r uctional 
posi t ion a n d t h e le ve l of funding provided for inst r uc t ion. ” 

Issue: Integrating Performance-Based Budgeting and Statutory Account- 
ability Reporting 

Recommendation: 

9. To the extent possible, measures used by public postsecondary edu- 
cation systems for accountability reporting should be consistent with 
those used for performance-based budgeting. 

Issue: Reporting in Accessible and Understandable Format 
Recommendation: 

10. Each system-level accountability report should provide a system-wide 

, summary for every measure contained in the institutional account- 

ability reports. The SUS and ICUF accountability reports should 
summarize the results of institutional surveys of students, alumni, 
and/or employers, achieving this by limiting institutions to brief ex- 
ecutive summaries of institutional survey processes and results. 

Issue: Goal Setting 
Recommendation: 

11. The State University System Accountability Plan should establish 
system goals in terms of benchmarks to peer systems or improve- 
ment from baseline performance, with target dates for goal realiza- 
tion. The Community College System Accountability Plan should 
substitute the specific target year in place of current reference to 
'fiv^ y^or goals " in the plan. 

ERIC 
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In 1994, the Florida Legislature revised the Commission’s statutory authority 
with regard to accountability, directing the Commission to: 

Periodically review the design and implementation of the ac- 
countability processes and reports of the State University Sys- 
tem, State Community College System, and public and inde- 
pendent postsecondary institutions. At least every 5 years, 
evaluate the extent to which each plan is contributing to the 
achievement of state goals for postsecondary education and 
report to the State Board of Education, the President of the 
Senate, and the Speaker of the House of Representatives with 
recommendations on any changes needed in the accountabil- 
ity process or plans, (see Appendix C; Section 240.147, Florida 
Statutes) 

Additionally, proviso language accompanying Specific Appropriation 198 of 
the 1995 General Appropriations Act directed the Commission to continue its 
accountability review, assessing the degree to which institutional and system 
goals relate to state priorities. 

The Commission Chairman appointed a Finance/ Administration Committee, 
chaired by Dr. Richard Alterman, to direct this study. Other Committee mem- 
bers were Inez Bailey, Thomas Haynes, James Kirk, and Earl Olden. The 
Committee discussed the study four times between May and December 1995 
and received public testimony. In addition to reviewing system and institu- 
tion accountability plans and reports, Commission stalf had conversations with 
sector board staff, legislative staff, and institutional representatives and at- 
tended meetings of the State University System and Community College 
System on accountability and performance-based budgeting. The Commis- 
sion gratefully acknowledges the cooperation of staff from the Board of Re- 
gents, the State Board of Community Colleges, and the Independent Colleges 
and Universities of Florida. 

In Challenges, Realities, Strategies: The Master Plan for Florida Postsec- 
ondary Education for the 21st Century (1993), the Commission endorsed 
targeting a few priorities as a strategy for dealing with the fiscal realities that 
constrain accountability expectations. After a review of all current postsec- 
ondary master plans in Florida and the strategic plans of the Department of 
Education and the Office of the Governor, the Commission’s 1993 report, 
Accountability in Florida *s Postsecondary Education System, identified three 
themes which cut across postsecondary sectors: quality of undergraduate edu- 
cation, productivity, and access/diversity. These priority areas also align with 
the State Comprehensive Plan’s goal statement for education (Section 1 87.20 1 , 
Florida Statutes). The priority areas provide the focus for the Commission’s 
review. 

The 1994 State University System (SUS) Accountability Report responds to 
10 measures in statute (see Appendix C; Section 240.214, Florida Statutes) 
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and includes various other measures emanating from eight planning direc- 
tives contained in the 1993-1998 SUS Master Plan (Appendix B), for a total 
of 50 measures. 

The five statewide measures in the 1994 Community College System (CCS) 
Accountability Plan are also contained in statute (see Appendix C; Section 
240.324, Florida Statutes), and focus exclusively on student outcomes. The 
measures are derived from eight planning directives in the CCS Master Plan 
(Appendix B) and are aligned with the broader goals found in the community 
colleges’ statutory mission (Section 240.301, Florida Statutes). 

At the direction of the 1994 Legislature, the Commission consulted with inde- 
pendent institutions that participate in the Florida Resident Access Grant 
(FRAG) program to recommend accountability measures and a process for 
those institutions (see Appendix C; Section 240.147, Florida Statutes). The 
institutions that participate in the FRAG are the 22 four-year, SACS accred- 
ited members of the Independent Colleges and Universities of Florida (ICUF) 
and the University of Miami. The 12 indicators used by these independent 
institutions for accountability reporting are displayed in Appendix A, along 
with the measures currently in statute for the state universities and community 
colleges. 



As set forth in the Accountability Review: Progress Report, 

the Commission’s review process follows a two-tier approach. Annual re- 
views over four years focus on the design and implementation of the account- 
ability processes and reports of both public systems. For purposes of the re- 
view, the 1994 system and institutional accountability plans and reports are 
the primary resource documents. Annual review questions examine the rela- 
tionship between accountability and continual improvement in public institu- 
tion effectiveness. A secondary purpose of the aimual review is to report 
current public and independent sector performance on key indicators related 
to the statewide accountability priorities — quality of undergraduate educa- 
tion, productivity, and access/diversity. A fifth-year summative review to be 
conducted in 1999 will assess system-wide progress with regard to the state 
priority areas. 

Each annual review is based on a sample of state universities and community 
colleges diverse in size, mission, and location (Appendix D). The sampling 
process will allow the accountability plans and reports of all public institu- 
tions to be reviewed over a four-year period. This document reports results of 
the first of the Commission’s annual reviews. Representatives of the Board of 
Regents and the State Board of Community Colleges assisted in placing their 
institutions in the reyiew schedule. Institutions selected for review of 1993- 
94 accountability reports were Florida State University (FSU), the University 
of Central Florida (UCF), and the following community colleges: Broward, 
Gulf Coast, Indian River, Lake City, Polk, St. Petersburg, and South Florida. 
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In its two previous reports on accountability, the Commission espoused that 
accountability serves dual purposes — to aid in institutional improvement and 
to provide the Legislature and the public with information about system 
progress in addressing statewide priorities. With regard to the first purpose, a 
statewide accountability process is beneficial but not sufficient. State account- 
ability data should certainly be part of an institution’s overall assessment and 
improvement plan. An institution’s long-range strategic planning, however, 
must of necessity incorporate detailed institution-level data that would be in- 
appropriate for a state-level accountability program. 

The community colleges have allowed for these dual purposes of accountabil- 
ity by providing two sections in each institutional accountability report: a sec- 
tion to report data related to the measures in statute and a supplemental sec- 
tion that allows institutions to report goals, activities, and data related to insti- 
tution-specific measures. One of the purposes stated in the Community Col- 
lege System 1994 Accountability Plan is “the establishment of a viable pro- 
cess that allows the institutions to assess and improve their quality and effec- 
tiveness.” Institution-specific measures contained in the institutional plans 
sampled relate to areas such as faculty productivity, continuing education, 
and the increased use of educational technology in instruction. Indian River 
Community College’s Strategic Plan to Improve Institutional Effectiveness 
provides an exemplary model for integrating the state’s accountability initia- 
tive with institutional efforts toward continual improvement. 

Each community college plan, following a format devised by the State Board 
of Community Colleges’ Committee on Accountability and Effectiveness, 
demonstrates how institutional goals support the Community College System 
Master Plan goals and, in turn, the community colleges’ statutory mission. 
The Community College System Accountability Plan has set quantitative five- 
year goals for the system with regard to each statutory measure, and each 
institution is required to set five-year goals for itself An institution might 
currently be performing above the system goal on one measure and below the 
system goal on another. Each institution has also enumerated activities it is 
undertaking in order to achieve its goals with regard to the statutory and insti- 
tution-specific measures. 

Although it is difficult to accurately assess the degree of constituent involve- 
ment by reading the plans, each community college plan in the sample re- 
ported faculty, administration, and student participation in goal-setting, as- 
sessment, data review, and redirection of institutional efforts. South Florida 
Community College reported that while a central committee provides coordi- 
nation and quality control over planning processes, nearly 60 percent of all 
employees participate in institutional planning processes in some way. All 
but two of the seven community college plans indicated some process by which 
constituents external to the institution were also involved in the planning pro- 
cess. Lake City Community College has established an Advisory Committee 
for each educational program area composed of business, academic, and gov- 
O 
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eminent representatives. The Commission’s review of a sample of institu- 
tional plans revealed that accountability data are evaluated and fed back into 
future planning through a variety of mechanisms. 

The State University System has taken a different approach to responding to 
the accountability legislation. In contrast to the State Board of Community 
Colleges, the Board of Regents no longer requires institutions to submit an 
annual accountability plan. The Board of Regents’ Accountability Commit- 
tee, consisting of board staff and institutional representatives, provides over- 
sight and direction to the process, and institutions provide data in response to 
the measures. Where data were of a qualitative or non-standard nature, the 
1994 State University System Accountability Report referred the reader to 
individual institutional reports. In the future, individual institutional account- 
ability reports will no longer be required. 



The following section presents data reflecting current public and independent 
sector performance on indicators related to state accountability priorities — 
quality of undergraduate education, productivity, and access/diversity. The 
public sector data are sampled from measures in statute; the independent sec- 
tor data are related to the measures recommended by the Commission. In cases 
where the SUS report did not aggregate systemwide data, the FSU and UCF 
reports were consulted as examples. Although not intended to be exhaustive, 
this section gives a flavor of the kinds of data contained in the sector-level 
reports. 



oo At FSU, 1988-89 bachelor’s degree recipients were surveye d three years 
after graduation as to their satisfaction with thtir education at FSU and the 
quality of education in their academic department. Ninety-five percent 
said they would attend FSU again if they could repeat their undergraduate 
education, up from 92 percent in the class of 1980-81. Eighty- nine per- 
cent rated the quality of instruction in their department as excellent or 
good, while only 1 .3 percent said it was poor, 
oo Of graduating seniors surveyed at UCF, 92 percent said they would rec- 
ommend UCF to a friend; 89 percent reported that their academic experi- 
ence was either excellent or good. 

oo Employers rated approximately 50 percent of UCF graduates they had 
hired as “superior” or “above average.” 
oo According to the Department of Business and Professional Regulation, 
SUS average passing rates on professional licensing examinations ranged 
from a low of 64 percent (out of 1 ,282 Engineering Intern examinees) to a 
high of 100 percent ^ it of 2 Marriage and Family Therapy examinees). 
The overall pass rate for 1 6 disciplines reported was 79 percent, 
oo The 1992-93 pass rate for SUS graduates oh all teacher certification sub- 
ject area examinations was 96 percent, and 99.6 percent on the Profes- 
sional Education section of the Florida Teacher Certification Examination 
(FTCE). 
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oo In a recent survey of school principals in counties where graduates of 
FSU’s College of Education are known to be employed, 59 percent of 
FSU graduates were rated as above average teachers, and 37 percent were 
rated average. Only two percent were rated below average. 

Eighty-seven percent of all students who took licensure examinations 
passed. The CCS goal is 90 percent. 

oo There was a 63 percent CLAST pass rate among AA degree-seeking stu- 
dents with 60 credit hours who had completed a college preparatory pro- 
gram, 86 percent for students who were not placed in a college prepara- 
tory program. The CCS goals are 68 and 90 percent, respectively. 

oo Among AA-degreed transfers in the SUS, 87 percent had at least a 2.0 
GPA during the year following transfer, 68 percent had at least a 2.5 GPA, 
and 43 percent had at least a 3.0 GPA. The CCS goal is for at least 70 
percent of the AA graduates who have transferred to a state imiversity 
perform at or above a 2.5 GPA. 

oo Based on data for only 6 of the 23 institutions, the independents’ pass rate 
on the FTCE Professional Education examination was 98.8 percent, and 
77 percent on teacher certification subject area examinations overall. 

The independent institutions identified class size as an indicator of qual- 
ity. Average undergraduate course section size in Fall 1994 was 19. 83 
percent of all undergraduate course sections contained fewer than 30 stu- 
dents, and the largest single undergraduate course section in any reporting 
independent institution was 214. 

Specialized accreditation or re-accreditation was granted for 1 9 of 2 1 aca- 
demic programs that sought it in 1993-94 and is pending for the other two 
programs. 

oo Responses from surveys of students, alumni, and employers as to institu- 
tional quality were unavailable in the inaugural independent report. 



oo The percentage of continuing FTIC students graduating within four years 
has increased from 21 percent to 25 percent from the Fall 1984 cohort to 
the Fall 1989 cohort. 

The six-year graduation rate for the Fall 1988 FTIC cohort was 48 per- 
cent. 

The percentage of community college AA transfer students graduating 
within two years increased from 16 percent with the Fall 1984 cohort to 
36 percent with the Fall 1990 cohort. 

Retained or graduated 6 1 percent of the Fall 1 990 FTIC AA degree-seek- 
ing cohort and 63 percent of the Fall 1990 FTIC AS degree-seeking co- 
hort. The CCS goal is 70 percent. 

oo Eighty-three percent of the students who completed a vocational program 
were placed in an occupation related to their field. The CCS goal is 90 
percent. 
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Access and 
Diversity 

State Universities 



Community Colleges 



Independent 

Institutions 



Based on data from only six of the 23 institutions, 33 percent of the 1988 
FTIC cohort had graduated with a baccalaureate degree four yearlater, and 
54 percent were graduated or still enrolled. The six year graduation rate 
of the cohort was 47 percent. 

Seventy-six percent of all undergraduate sections are taught by regular 
full-time faculty, and 59 percent are taught by full, associate, or assistant 
professors. 24 percent of undergraduate sections are taught by supple- 
mental faculty such as adjuncts and teaching assistants. 

Based on 1988 FTIC cohort data from 10 of the 23 institutions, students 
averaged only 6.8 more semester hours to graduate than the mean required 
in the catalog and had an average time to degree of 4.3 academic years. 



The SUS reclassified 22 limited access programs as open access programs, 
and 58 programs expanded, resulting in approximately 1300 more seats in 
high demand majors at the undergraduate level. 

Using student demand data from students’ attempts to register by touch- 
tone telephone for full course sections in Spring and Summer 1994, FSU 
opened 600 additional course sections to meet demand for Fall 1994. 
While the four-year graduation rates of alternatively admitted FTIC stu- 
dents has remained relatively constant (around 9 percent) over the past 
four years, the six-year graduation rates for these students increased from 
27 percent to 34 percent from the 1984 cohort to the 1988 cohort. 

FSU and UCF both reported increases in the percentage of upper division 
undergraduate enrollment represented by Black, Hispanic, Asian, and 
Native American students from Fall 1992 to Fall 1993. 

Community college enrollments closely mirror the racial/ethnic distribu- 
tion of the previous year’s public high school graduates; a slightly greater 
percentage of community college students are Hispanic, and a slightly 
lower percentage are Black. 

Slightly under two-thirds of the students who tested into and enrolled in 
College Prep Reading and Writing had completed the highest level related 
college preparatory course within two years. Of students who tested into 
and enrolled in College Prep Math, 46 percent had successfully completed 
the highest level College Prep Math course within two years. 

Among full-time transfer students with an AA degree from a community 
college with whom the institution had an articulation agreement, 100 per- 
cent gained immediate access to their chosen field of study. 38 percent of 
those students had graduated with their baccalaureate degree two years 
later, and 65 percent had graduated three years later. (Note: The gradua- 
tion rate data are based on reports from only six of the 23 institutions that 
participate in the FRAG program.) 

The independents’ report contains a faculty profile by rank, gender, and 
race as a diversity measure supplemental to the productivity measure of 
faculty teaching load. Of total faculty, 72 percent are men, 80 percent are 
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white, 8 percent are Hispanic, and 5 percent are Black non-Hispanic. 

Among tenured faculty, 80 percent are male and 89 percent are white. 

The data summarized above, sampled from system- or association-level ac- 
countability reports; present a snapshot of current public and independent sec- 
tor performance on indicators related to state accountability priorities. The 
SUS Report was the only one of the three system reports to provide any trend 
data. The Community College System report was its first to contain actual 
data. The independents’ report was their first ever and was based on incom- 
plete institutional reporting. Even so, these data are a first step in establishing 
a baseline against which trends in each system’s contribution to the realiza- 
tion of statewide priorities may be assessed in the future. This will be the 
objective of the Commission’s fifth-year summative review in 1999. 



In its Accountability Review: Progress Report, the Commission designed its 
annual accountability review as a document analysis of public system account- 
ability plans and reports and a sample of public institutions’ plans and reports. 
There are two limitations with this methodology. First, as noted earlier, the 
Board of Regents no longer requires each university to submit an annual ac- 
countability plan. Second, even though community college plans describe the 
integration of accountability and other institutional plarming efforts, it is dif- 
ficult from a document analysis to evaluate the extent to which accountability 
is viewed by various campus constituents as a vehicle for institutional im- 
provement, as opposed to being an add-on activity. The extent to which fac- 
ulty, administration, and students support, are involved in, and benefit from 
the accountability process is not clear from a document review. 

A 1995 Education Commission of the States report. Making Quality 
Count in Undergraduate Education, asserts that since judgments 
about quality are not always quantifiable, measures of quality are inadequate 
without direct observation. While care should be taken not to make site visits 
burdensome, one-day site visits by teams consisting of Commission, BOR, 
and SBCC staff could assess accountability’s role in institutional improve- 
ment on a sample of campuses and enable the Commission to submit a more 
complete and better-informed review. Site visits would also give the Com- 
mission the opportunity to interview faculty and students about the effect of 
recent legislative initiatives to increase instructional productivity, shorten de- 
gree requirements, and decrease student credits earned in excess of degree 
requirements. A listing of example site visit questions is contained in Appen- 
dix F. 

The Commission’s future accountability reviews will utilize information from 
site visits and document reviews to arrive at recommendations addressed to 
the purveyors of accountability information as to how the process might be 
improved. This document will be accompanied by a brief consumer-oriented 
piece that graphically presents data across postsecondary delivery systems 
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reflecting system-level performance in addressing statewide accountability 
priorities. 

Recommendation: 

1. The Commission should supplement future analyses of an annual sample 
of public institution accountability plans, processes, and reports with 
site visits to the universities in each sample and two community col- 
leges, in order to further assess their use of the accountability process 
for institutional improvement 



Community Colleges Since 1982, the College Level Academic Skills Test (CLAST) has been the 

state’s primary measure of students’ readiness to progress to upper division 
CLAST Alternatives academic work. In 1995, CS/HB 821, the “Robert H. McCabe CLAST and 

Other Skills Act,” revised the requirement that every student must pass the 
CLAST as a condition of earning an AA degree or of entering the upper divi- 
sion of a university. Beginning January 1, 1996, a student will be exempted 
from taking the test by: 

- meeting a minimum score on a nationally standardized examination 
listed in the articulation agreement. 

- passing the college placement test and earning a grade point average of 
at least 3.0 on certain college preparatory high school courses to be 
recommended by the Articulation Coordinating Committee 

- passing the college placement test and earning a grade point average of 
at least 2.5 on postsecondary level coursework to be recommended by 
the Postsecondary Education Plarming Commission. 

The Community College System accountability statute currently calls for a 
measure of student performance on the CLAST, which the Community Col- 
lege System Accountability Plan addresses by reporting the number and per- 
cent of students who have completed 60 or more college credits and have met 
the CLAST passing standards. 

Recommendation: 

2. As alternatives to the CLAST are developed pursuant to CS/HB 821, the 
Community College System should develop accountability measures that 
supplement student CLAST pass rates with the number and percentage 
of students exempting the CLAST via each alternative. 



State Universities 

Reporting of 
Instructional 
Productivity 



In Challenges, Realities, Strategies: The Master Plan for Florida Postsec- 
ondary Education for the 2Ist Century, the Commission noted that reward 
systems in higher education do not adequately recognize or compensate teach- 
ing activity, resulting in reduced faculty participation in teaching. The Mas- 
ter Plan also reported that 50 percent of lower level instructional contact hours 
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are generated by adjuncts, teaching assistants, and other part-time instruc- 
tional staff. The Office of Program Policy Analysis and Government 
Accountability’s Assessment of the Revised State University System Account- 
ability Plan (1994) indicated that only 27 percent of the full-time faculty in 
the university system produced 12 or more instruction contact hours in the 
Fall 1993 semester. While the State University System accountability legisla- 
tion (Section 240.214, Florida Statutes) calls for a reporting of the “total num- 
ber of contact hours of instruction produced by faculty, by institution, rank, 
and course level,” the 1994 SUS Accountability Report did not respond to this 
requirement. 

Recommendation: 

3. State University System data regarding instructional contact hours should 
be reported in a manner that allows for an analysis of faculty instruc- 
tional activities by rank across lower undergraduate, upper undergradu- 
ate, and graduate levels. 



The State University System accountability legislation also calls for a report- 
ing of the “length of time and number of academic credits required to com- 
plete an academic degree, by institution and by degree.” The wording of this 
measure leaves its intent subject to interpretation. Measure 12 of the 1994 
SUS Accountability Report addresses this requirement by providing an in- 
ventory of SUS baccalaureate degree programs with credit hour requirements 
within or above an acceptable range of 120-128 credit hours to the degree. 
However, recent legislative interest with regard to credit hours taken by stu- 
dents in.excess of those required for the degree would seem to call for a more 
complete response that addresses not only program requirements, but actual 
credits taken by students in pursuit of the degree. Furthermore, the universi- 
ties would be best served by disaggregating credit hours earned at the institu- 
tion from which the student graduated from credit hours amassed at other 
institutions. 

Recommendation: 

4. State University System accountability reporting with regard to time to 
degree should include, by institution, the average number of credit hours 
taken beyond degree requirements. 




Reporting on certain measures that required student cohort tracking was op- 
tional in the inaugural ICUF Accountabilit>' Report, as institutions were given 
time to phase in data collection on a common student cohort. Therefore, the 
measures on time to degree, accumulated student debt, FTIC retention and 
graduation rates, and transfer student graduation rate had very low response 
rates — roughly one fourth of all institutions. 
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Recommendation: 

5. Beginning with its 1994-95 Accountability Report, the ICUF institu- 
tions should include data on all indicators that were optional in 1993-94 
while data collection on a common student cohort was being phased in. 



Even on measures that were fully operational for the 1993-94 reporting year, 
the inaugural ICUF Accountability Report showed that less than 100 percent 
of institutions (20 out of 23) provided data in a manner consistent enough that 
it could be compiled with that of other institutions. The Commission’s Ac- 
countability Review: Progress Report, concluded that individual institutional 
data should be included in appendices of the ICUF Accountability Report, but 
no institutional data were appended to the inaugural report. 

Recommendation: 

6. The independent sector should continue to seek full institutional par- 
ticipation in accountability reporting. To aid in interpretation of reported 
data, any non-reporting institutions should be listed with each indica- 
tor. Individual institutional data should appear in appendices of the 
independent sector Accountability Report 



The 1 995 Legislature, as part of its “Higher Education Access 2000 Act,” 
enacted a limited access competitive grant program to provide enrollment 
opportunities in the independent sector for qualified community college gradu- 
ates and state university students who are Florida residents and who, because 
of a lack of space; are unable to obtain admission to selected state university 
limited access programs or equivalent academic tracks (Section 240.6045, 
Florida Statutes). As directed by the Legislature, the Commission recom- 
mended certain baccalaureate programs directly related to high priority em- 
ployment fields for inclusion in the program, and the Commission’s recom- 
mendations were subsequently approved by the State Board of Education. 
The Legislature also instructed the Commission, in consultation with the Board 
of Regents, the State Board of Community Colleges, ICUF, and the State 
Board of Education, to recommend an accountability process for the program. 
The process is to assess the program’s benefits and cost-effectiveness and is 
to make use of existing information submitted by the respective system in 
conjunction with the establishment of the program. The Commission circu- 
lated the accountability measures and process proposed in Appendix E to the 
above parties and presented its proposal at the September 1 995 meeting of the 
ICUF Presidents Council. 

Recommendation: .. 

7. Future independent sector Accountability Reports should contain data 
for the accountability measures in Appendix E related to the Limited 
Access Competitive Grant Program. 
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In addition to the accountability legislation, the Community College System 
and the State University System are both currently responding to other leg- 
islative accountability-related initiatives. Senate Bill 2330 calls for both 
public postsecondary sectors to reduce general education requirements to 36 
credit hours and requires the universities to standardize prerequisites, desig- 
nate courses as upper- or lower-level, reduce the baccalaureate degree re- 
quirements to 120 hours with a few exceptions, and reduce the number of 
credits taken by students in excess of those required for a degree. The 
Instructional Performance Incentive Fund, created in proviso of the 1995 
Appropriations Act, provides $15 million for universities to achieve various 
productivity-related targets. The Commission heard testimoriy from board 
representatives that the measures pursuant to each of these initiatives, while 
similar, are dissimilar enough to require separate data runs and presentation 
preparation. 



Accountability 
Issues That 
Cross Sectors 

Responding 
to Multiple 
Accountability- 
Related Initiatives 



The Community College System accountability statute (Section 240.324, 
Florida Statutes) calls for Community College System Accountability Plan to 
address five issues. Although the 1994 CCS Plan was its first to include data, 
each CCS plan has consistently addressed the five statutory issues since 1991. 
The State University System accountability statute (Section 240.214, Florida 
Statutes) does not contain “issues” language, but rather calls for the SUS to 
report on nine specific measures contained in statute. The first two SUS Ac- 
countability Reports addressed the statutory measures. The 1994 SUS report 
had expanded to some 50 measures while omitting a few of the statutory mea- 
sures. For 1995 accountability reporting, the SUS plans to refocus on far 
fewer measures (16) relating to nine key objectives that support the universi- 
ties’ tripartite mission of teaching, research, and public service. 

The Commission supports the continual refinement of measures, and particu- 
larly, the universities’ planned addition of measures related to research and 
public service. The SUS accountability legislation calls for the monitoring of 
system- level performance in each of the major areas of the university system’s 
tripartite mission — teaching, research, and public service. The Commission 
is concerned, however, that accountability has become a “moving target” for 
the institutions and for state-level policymakers attempting to follow system 
progress over time. An appropriate solution to the “moving target” problem 
is to remove specific measures from the SUS accountability statute, replac- 
ing them with key issues that are aligned with the statewide priority areas 
identified by the Commission — productivity, access/diversity, and quality 
of undergraduate education. (Guidance on arriving at indicators of quality 
is contained in Appendix G.) In return for this added flexibility, the SUS 
would then be required to include consistent data that are comparable across 
time to address those issues in each annual accountability report. 

Recommendation: 



8. Section 240.214 (1), Florida Statutes, should be revised to read The 
annual accountability report shall include goals and measurable objec- 
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fives related to the system-wide strategic master plan pursuant to s. 

240.209. The report phm must include, at a minimum, svstem-wide per- 
formance targets, measures, and data o bjec t ives related to the following 

issues me a sures : 

(a) Undergraduate teaching productivity and class size: To ta l student 
cre di t hours; 

(b) Access and diversity; Tot a l number of cont a c t hour s of instruction 
p r oduced by faculty, by instituHon, rank, and course level; 

(c) Baccalaureate degree retention and graduation: P as s r a t e s on pr o~ 
fessional licensure e x amina t i o ns, by institution; 

(d) Progression to the baccalaureate degree: Instituti o nal quality as as- 
sessed by fbll ov Mtp, such a s anafy s es of employmen t inf o rmation on 
for m e r s tu dents, na t i o nal rank in g s , and surveys of alumni, parents, 
clie n t s , and empl o yer s ; 

(e) Research: Leng th of time and numbe r of academic cr e dit s required 
to complete an academic deg re e, by institution and by degree; 

(f) Public service: and Enr o llment, progression, re te ntion, and g r adual 
tion r a t e s by race and gender; 

(g) Institutional quality. Student course demand: 

^ An analysis of administ r at i v e and suppor t functions; 

fij Every 3 years, beginning 1 995-96, an analysis of the cumulat i ve debt 
of st u dents; and 

^ An evalua t ion of the pr o duc t ion of classroom cont a c t hours at each 
univ e rsity in comparis o n to a s ta ndard of 12 co nt a c t hour s per t e rm 
or 32 cont a ct hours per year f o r each full - time inst r uctional position 
and the level of funding provided f o r inst r uction. ” 



Integrating 
Performance-Based 
Budgeting and 
Statutory 
Accountability 
Reporting 



As noted earlier, the completion of accountability plans and reports is only 
one of the accountability-related activities required of Florida’s public post- 
secondary institutions and systems. Another recent accountability-related ini- 
tiative is the Government Performance and Accountability Act of 1 994, which 
requires the use of performance budgeting in state agency and budget submis- 
sions. The Division of Community Colleges has submitted a draft of perfor- 
mance budgeting measures to accompany its 1996-97 Legislative Budget 
Request. There is considerable overlap between the CCS accountability mea- 
sures and the proposed performance budgeting measures. In 1996, the State 
University System will be required to submit a performance based budget for 
the 1997-1998 fiscal year. 



Performance-based budgeting and the accountability reporting required by 
statute are similar processes in that both are concerned with demonstrating to 
various stakeholders the achievement of specified levels of system and insti- 
tutional performance with regard to effectiveness and efficiency. The pro- 
cesses, however similar, are complementary rather than redundant. While the 
issues addressed should remain the same, the level of data aggregation is dif- 
ferent. Funding decisions at the state level, while based on the compilation of 
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unit-level data, require the eventual aggregation of data at a gross level that 
would be inappropriate for an accountability report. Information disaggre- 
gated by institution, level, or discipline is the purview of the accountability 
report. 

Recommendation: 

9. To the extent possible, measures used by public postsecondary educa- 
tion systems for accountability reporting should he consistent with those 
used for performance-based budgeting. 



In Accountability in Florida*s Postsecondary Education System (1993), the 
Commissi* a asserted that one characteristic of a state-level accountability 
process is a report to the public in an accessible and understandable format. 
Each sector board has the responsibility of compiling large amounts of insti- 
tutional data that are often diverse in nature. The SUS 1994 Accountability 
Report often referred the reader to the individual institutional reports in in- 
stances where reporting is non-standardized (e.g., results of surveys of alumni 
or employers) or data are qualitative in nature (e.g., descriptions of institu- 
tional efforts to improve teaching). This should become less problematic, as 
the SUS appears to be moving toward a more quantitative approach to ac- 
countability reporting. The independent sector Accountability Report omit- 
ted any discussion of surveys of students, alumni, or employers as to institu- 
tional quality, 

Recommendation: 

10. Each system-level accountability report should provide a system-wide 
summary for every measure contained in the institutional accountabil- 
ity reports. The SUS and independent sector accountability reports 
should summarize the results of institutional surv^s of students, alumni, 
and/or employers, achieving this hy limiting institutions to brief execu- 
tive summaries of institutional survey processes and results. 



The State University System Revised Accountability Plan indicates that 
progress with regard to many of the objectives is to be measured by compar- 
ing current year to prior year performance. For example, progress on the ob- 
jective of increasing the percentage of continuing full-time FTIC students 
graduating in four years is measured by comparing graduation rates to the 
prior year. Target dates for goal realization are not set. Benchmarking sys- 
tem performance to that of university systems in peer stated identified by the 
SUS may provide another beneficial means of assessing system performance. 
The Community College System Accountability Plan establishes five-year 
goals for system performance at a level just above current performance. 
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Recommendation: 

11. The State University System Accountability Report should establish sys- 
tem goals in terms of benchmarks to peer systems or improvement from 
baseline performance, with target dates for goal realization. The Com- 
munity College System Accountability Plan should substitute the spe- 
cific target year in place of the current reference to “five year goals** in 
the plan. 
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ACCOUNTABILITY REPORTING REQUIREMENTS, BY SECTOR 



State University StaU'te 


Commuaity CoUcget, Statute 


Independent institutions, Recommended 
by PEPC 


1. Total student credit hours. 


1. Graduauon rates of AA and AS degree- 
seeking students compared to ftrst-time 
enrolled students seeking the associate 
degree. 


la. Distribuuon of undergrad, teaching load for 
full-time faculty, by instimtion. 

lb. Faculty profile by rank, gender, and race/ 
ethnicity. 


2. Total number of contact hours of 
instruction produced by faculty, by 
institution, rank, and course level. 


2. Minority student enrollment and retention 
rates. 


2. Distribution of undergrad, course sections 
uught by ranked and supplemenul faculty, 
by institution and course level. 


3. Pass rates on professional licensure 
examinations, by institution. 


3. Student performance, including student 
performance rates on college level 
academic skills tests, mean grade-point 
averages for community college AA 
transfer students, and community college 
student performance on state licensure 
exams. 


3. Number of academic years and academic 
credits to complete a baccalaureate degree 
(a) as required in caulog and (b) actually 
taken by cohort of full-time students, by 
instituuon and discipline. 


4. Institutional quality as assessed by 
foIlow*up. such as analyses of 

employment information on former 
students, national rankings, and surveys 
of alumni, parenu. clienu. and 

employers. 


4. Job placement rates of community college 
vocational students. 


4. Average debt accumulated by cohort of 
FRAG recipients in Sufford. Perkins, and 
institutionally-funded loans upon receipt of 
baccalaureate degree, by institution. 


5. Length of ume and number of academic 
credits required to complete an 
academic degree, by instinition and by 
degree. 


5. Student progression by admission sums 
and program. 


5. Average total state cost per Florida resident 
undergrad, student (a) per academic year 
and (b) per undergrad, degree, including 
programs supported by an academic contract 
with the Sttte. by institution. 


6. Enrollment, progression, retention, and 
graduation rates by race and gender. 


6. Other measures as idenufied by PEPC and 
approved by the SBCC. 


6. Four-, five-, aad six-year retention and 
graduation rates of cohort bf first time in 
college (FTIC) students, by institution, 
race/ethnietty. and gender. 


7. Student course demand. 




7. Matriculated AA degree transfer students 
from Florida community colleges gaining 
immediate access to chosen field of study, 
by institution. 


8. An analysis of administrative and 
support functions. 




8. Matriculated AA degree transfer smdents 
from Florida community colleges graduating 
within 2 and 3 years subsequent to 
institutional admission, by institution. 


9. Every 3 years, beginning 1995-1996. 
an analysis of the cumulative debt of 
students. 




9. Pass rates on professional licensure 
examinations. b>. instimtion and professional 
field. 


10. Evaluation of classroom contact hour 
production at each university in 
comparison to a standard of 12 contact 
hours per term or 32 contact hours per 
year for each full-time instructional 
position and the level of funding 
provided for instruction 




10. Institutional qualitv/eftecuveness as assessed 
by surveys of alumni, parents, students, and 
emplov ers ; and as reported by pertinent 
national rankings. 






11 Average undergraduate course section sizes, 
by tmtituuon and discipline. 


JC 




12. Results of academic programs' attempts at 
accrediution or re-accrcdiution. 
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GOALS CONTAINED IN PUBLIC POSTSECONDARY SYSTEM 

MASTER PLANS 

State University System Plan ning Directives 

1 . Improve the quality of undergraduate education. 

2. Provide adequate access to undergraduate education. 

3. Establish a stable, reliable source of state funding. 

4. Develop and implement creative and innovative cost-saving programs to increase 
efficiency without sacrificing quality. 

5. Solve critical problems in a rapidly growing state. 

6. Forge public/private partnerships to help achieve state goals. 

7. Improve the quality of libraries. 

8. Provide qualicy student advising. 

Community College Syste m Goak 

1 . Preserve open access and increase student success. 

2. Strengthen the quality of programs and curricula. 

3 . S-trengthen articulation, cooperation, and collaboration. 

4. Establish partnerships for economic development initiatives and strategies. 

5. Strengthen the human resources of the community colleges. 

6. Strengthen the utilization of technology'. 

7. Renew Florida’s commitment to community college fiscal stability. 

8. Strengthen and provide leadership in institutional accountability. 
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Postsecondan’ Education Planning Commission (240.147, Florida Statutes) 



240.147 Powers and dutica of the eemmiasion.— 

The commission shall: 

(1 ) Serve as a citizen board to coordinate the efforts 
of postsecondary institutions in this state and provide 
independent policy analyses and recommendations to 
the State Board of Education and the Legislature. 

(2) Prepare and submit to the State Board of Educa- 
tion a master plan for postsecondary education. The 
plan Shall include consideration of the promotion of qual- 
ity. fundamental educational goals, programmatic 
access, needs for remedial education, regional and 
state economic development, international education 
programs, demographic patterns, student demand for 
programs, needs of particular subgroups of the popula- 
tion. implementation of innovative educational tech- 
niques and technology, and the requirements of the 
labor market. The capacity of existing programs, in both 
public and independent institutions, to respond to iden- 
tified needs shall be evaluated, and a plan shall be 
developed to respond efficiently to unmet needs. 

(3) Recommend guidelines for the development of 
institutional roles, review plans of the postsecondary 
boards and institutions, and relay these plans to the 
State Board of Education and the Legislature. 

(4) Recommend to the State Board of Education 
contracts with independent institutions to conduct pro- 
grams consistent with the state master plan for postsec- 
ondary education. In making recommendations, the 
commission shall consider the annual report submitted 
by the Board of Regents pursuant to 's. 240.209(3)(r). 
Each program shall be reviewed, with the cooperation 
of the institution, every 5 years. 

(5) Recommend to the State Board of Eaucation 
rules concerning the planrring and coordination of post- 
secondary educational programs. These rules shall pro- 
vide for the sector boards to assure that; 

(a) Program reviews are conducted statewide. 

(b) Every major program in public postsecondary 
education is reviewed every 5 years. 

(c) Budget requests reflect program review results 

(d) Program decisions lead to the distinctive roles 
established for public universities and community col- 
leges. 

(6) Advise the State Board of Education regarding 
the need for and location of new programs, institutions, 
campuses, and instructional centers of public postsec- 
ondary education. 

(7) Recommend to the State Board of Education for 
adoption criteria for the establishment of new commu- 
nity colleges and state universities, which criteria shall 
address; 

(a) Proximity to existing institutions and assessment 
of the impact on existing institutions. 

(b) Potential program duplication, 

(c) Regional demographic characteristics. 

(d) The efficient use of resources. 

(8) Recommend to the State Board of Education and 



the Legislature the establishment of additional branch 
campuses of public postsecondary educational institu- 
tions. No branch campus may be established without a 
review by the commission and formal authorization by 
the Legislature. Any community college branch campus 
established to provide only exploratory, occupational 
proiic'cncy. job-preparatory, and supplemental voca- 
tional and technical instruction must be reviewed and 
recommended again by the commission and receive 
specific authorization by the Legislature before expand- 
ing its instructional offerings to the college parallel pro- 
gram area. 

(9) Review the establishment of those instructional 
centers which require approval by the Board of Regents 
or the State Board of Community Colleges. 

(10) Review public postsecondary education budget 
recuests for compliance with the slate master plan 
before submission to the State Board of Education. 

(11) Assist the State Board of Education in the con- 
duct of its postsecondary educational responsibilities in 
such capacities as the state board deems appropriate. 

(12) Update the slate master plan for postsecondary 
education every 5 years. 

(13) Conduct studies and planning activities related 
to the overall improvement and effectiveness of post- 
secondary education In this state. 

(14) Review implementation of the state master plan 
and annually report to the State Board of Education and 
the Legislature the progress towards implementation. 

(15) In consultation with the independent Colleoes 
anc umversities^rFiorida. recommend to the Leo^la- 
tura accQuntAbilitv measures and an accountability 
process for independent institutions that participate m 
the Floriok resident access grant procram. The process 
shal' make use of existing information submitted to the, 
feoeral and state governm ents. The process shall prO: 
vioe for an assessment of the benefits and cost- 
effectiveness of the Florida resident access Qrant pro- 
gr^ln providing State residents with access to 4-year 

programs and with the successful completion of 
a baccalaureate degree. T he commission shall provtoe 
oversipy of this accountability process. 

nErPeriodicallv review the desior^ Tnd implementa- 
tion of the accountability processes and reports oMhe 
State University System, S tale Community Colleoe Svs7 
tern, and public and independent postsecondary institu- 



tions, At least every 5 years, evaluate the extent to which 
eac*"' plan is contributinq to the aefTievement of sti^ 
Qoaisjor postsecondary education and report tc t^ 



line Boarfl of Eflucation. the Presioent of the Senate, 
ing the Speaker oil the House of R epresentitives with 
reconriTienflations on any changes neeoed in the 
actountap.iitv process or alaos ^ 
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State University System (240.214, Fjorid* Statutes) 



240.214 Stale University System accountability 
procttt.— It is the intent of the Legislature that an 
accountability process be implemented which provides 
for the systematic, ongoing evaluation of quality and 
effectiveness in the State University System. It is further 
the intent of the Legislature that this accountability proc- 
ess monitor performance at the system level in each of 
the major areas of instruction, research, and public ser- 
vice. while recognizing the differing missions of each of 
the state universities. The accountability process shall 
provide for the adoption of systemwide performance 
standards and performance goals for each standard 
identified through a collaborative effort involving the 
State University System, the Legislature, and the Gover- 
nor's Office. The accountability process shall result in an 
annual accountability report to the Legislature. 

(1) The annual accountability report shall include 
goals and measurable objectives related to the system- 
wide master plan pursuant to s. 240.209. The plan must 
include, at a minimum, objectives related to the following 
measures; 

(a) Total student credit hours: 

(b) Total number of contact hours of instruction pro- 
duced by faculty, by institution, rank, and course level; 

(c) Pass rates on professional licensure examina- 
tions, by institution; 

(d) Institutional quality as assessed by followup, 
such as analyses of employment information on former 
students, national rankings, and surveys of alumni, par- 
ents, clients, and employers; 

(e) Length of time anj number of academic credits 
required to complete an academic degree, by Institution 
and by degree; 

(f) Enrollment, progression, retention, and gradua- 
tion rates by race and gender; 

(g) Student course demand; 

(h) An analysis of administrative and support func- 
tions; 

(i) Every 3 years, beginning 1995-1996, an analysis 
of the cumulative debt of students; and 

(j) An evaluation of the production of classroom 
contact hours at each university in comparison to a stan- 
dard of 12 contact hours per term or 32 contact hours 
per year for each full-time instructional position and the 
level of funding provided for instruction. 

(2) By December 31 of each year, the Board of 
Regents shall submit the annual accountability report 
providing information on the implefT>entation of perform- 
ance standards, actions taken to improve university 
achievement of performance goals, the achievement of 
performance goals during the prior yaar. and initiatives 
to be undertaken during the next year. The accountabil- 
ity reports shall be designed in consultation with the 
Governor's Office, the Office of the Auditor Ger>era!, and 
the Legislature. 

(3) The Board of Regents shall recommend in the 
annual accoun^bility report any appropriate modifica- 
tions to this section. 

c^ t a. 
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240.324 Community colitgt accountability proc* 

tM.— 

(1) It is the intent of the Legislature that a manage- 
ment and accountability process be implemented which 
provides for the systematic, ongoing improvement and 
assessment of the improvement of the quality and effi- 
cieacy of the State Community College System. Accord- 
ingly, the State Board of Community Colleges and the 
community college boards of trustees shall develop and 
implement a plan to improve and evaluate the instruc- 
tional and administrative efficiency and effectiveness of 
the State Community College System. This plan must 
address the following issues: 

(a) Graduation rates of AA and AS degree-seeking 
students compared to first-time enrolled students seek- 
ing the associate degree. 

(b) Minority student enrollment and retention rates. 

(c) Student performance, including student per- 
formance rates on college-level academic skills tests, 
mean grade point averages for com.nnunity college AA 
transfer students, and community college student per- 
formance on state licensure examinations. 

(d) Job placement rates of community college voca- 
tional students. 

(e) Student progression by admission status and 
program. 

(f) Vocational accountability standards identified in 
s. 239.229. 

(g) Other measures as identified by the Postsecond- 
ary Education Planning Commission and approved by 
the State Board of Community Colleges. 

(2) By January 1 , 1992, the State Board of Commu- 
nity Colleges shall submit to the Governor, the President 
of the Senate, and the Speaker of the House of Repre- 
sentatives a plan for addressing these issues. The plan 
must provide a specific timetable that identifies specific 
issues to be addressed each year and must provide for 
full implementation by December 31. 1994. Beginning 
December 31. 1992, the State Board of Community Col- 
leges shall submit an annual interim report providing the 
results of initiatives taken during the prior year and the 
initiatives end related objective performance measures 
proposed for the next year. The initial plan and each 
interim plan shall be designed in consultation with staff 
of the Governor and the Legislature. 

(3) Beginning January 1, 1993. the State Board of 
Community Colleges shall address within the annual 
evaluation of the performance of the executive director, 
and the boards of trustees shall address within the 
annual evaluation of the presidents, the achievement of 
the performance goats established in the community 
college accountability plan. 

HMnr.-i 12. er di-55. i $^.c^ S2-iX 
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STATE UNIVERSITIES 
ACCOUNTABILITY REVIEW SCHEDULE 



1995 


1996 


1997 


1998 


1999 


FSU 

(I. Large. Res I) 


USF 

(TV, Large. Res H) 


UF 

(II, Large. Res I) 


FAMU 

(I. Small. MA 1) 


Summaiive 

Review 


UCF 

(in. Mid. Doc n) 


FIU 

(V. Mid, MA I) 


FAU 

(V. Mid, Doc n) 


FGCU 

(TV, Small. BA) 




UNF 

(n. Small. MAP 


UWF 

a. Small, MA I) 





Key; Institution Name 

(Region, Size, Carnegie Classification) 

Region Codes: I=Panhandle, II=Northeast, III=Central & East Coast, IV=West Coast, V=South 
Size Codes: Small (under 10,000 total headcount). Mid (10,001-25,000), Large (over 25,000) 



COMMUNITY COLLEGES 
ACCOUNTABILITY REVIEW SCHEDULE 



1995 


1996 


1997 


1998 


1999 ‘ 


Lake City 
(n. Small. Voc) 


Si. Johns River 
(H, Small) 


Chipola 
(I, Small, Voc) 


North Florida 
a. Small. Voc) 


Summaiive 

Review 


South Florida 
(IV. Small. Voc) 


Tallahassee 
(I. 5-10) 


Rorida Keys 
(V, Small) 


Lake-Sumter 
an. Small) 


Gulf Coast 
a. 5-10, Voc) 


Manatee 

(TV, 5-10) 


Central Florida 
(n, 5-10, Voc) 


Edison 
(IV. 5-10) 


Polk 

cm, 5-10) 


Pensacola 
a. 10-20. Voc) 


Seminole 
(m, 5-10. Voc) 


Okaloosa-Walton 
(I. 5-10) 


Indian River 
(in. 10-20. Voc) 


Daytona Beach 

(in. 10 - 20 ) 


Pasco-Hemando 
av, 5-10, Voc) 


Santa Fe 
(D, 10-20, Voc) 


St. Petersburg 
(IV. Urge) 


Miami-Dade 
(V. Urge. Voc) 


Brevard 

(in, 10-20, Voc) 


Palm Beach 
(V. 10-20. Voc) 


Broward 

Urge. Voc) 


Fla. CC at J'ville 
(n. Urge. Voc) 


Hillsborough 
(TV. Urge) 


Valencia 
ail. Large. Voc) 



Key: Institution Name 

(Region, Size, Offers Vocational Education) 

Region Codes: I-Panhandle, II-Northeast, Ill«Central &. East Coast. IV»West Coast. V=South 

Size Codes: Small(undcr5,000total headcount), 5-10(5,001-10,000). 10-20 (10,001-20.000) Large (over 20.000) 
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LIMITED ACCESS COMPETITIVE GRANT PROGRAM: 
PROPOSAL FOR ACCOUNTABILITY PROCESS 



The 1 995 Legislature, as part of its “Higher Education Access 2000 Act,” enacted a limited access 
competitive grant program “to provide enrollment opportunities for qualified applicants unable to ob- 
tain admission to selected state university limited access programs or equivalent academic tracks” 
(Section 240.6045, Florida Statutes). As directed by the Legislature, the Commission recommended 
certain baccalaureate programs directly related to high priority employment fields for inclusion in the 
program. At its August 22, 1995 meeting, the State Board of Education approved the follo\\ing pro- 
grams to initiate the grant program for the 1 995-96 academic year. 



Special Education, General 
Education, Mentally Handicapped 
Education, Emotionally Handicapped 
Education, Specific Learning Disabled 
Pre-£lementary' Education Teacher 



Electrical /Electronics Engineering 
Nursing 

Occupational Therapy 
Physician Assistant 
Physical Therapy 



The Legislature also instructed the Commission, in consultation with the Board of Regents, the State 
Board of Community Colleges, the Independent Colleges and Universities of Florida (ICUF), and the 
State Board of Education, to recommend an accountability process for the program. The process is to 
assess the program’s benefits and cost-effectiveness and is to make use of existing information submit- 
ted by the respective system in conjunction with the establishment of the program. The Commission 
proposes the following meastires and process. 



Proposed Measure 


Data Provider 


Analysis 


1 . For each academic program above, the 
number of students in limited access 
grant cohort who graduated, left 
program, or continued to be enrolled 
three years after admission to ICUF 
institution. Disaggregate cohort by 
postsecondary sector of origin. 


Institutional research 
offices provide data to 
ICUF. 


ICUF, in sector-wide 
Accounubility Report. 
Begin in 1996. 


2. For each academic program above, 
professional licensure examination pass 
rates of all graduates (not just limited 
access grant recipients). 


Business and Professional 
Regulation provides data to 
ICUF. 


ICUF, in sector- wide 
Accountability Report. 
Begin in 1996. 


3. For each academic program above, 
training-related employment rates of all 
graduates (not just limited access grant 
recipients). 


FETPIP provides dau to 
ICUF. 


ICUF, in sector-w'ide 
Accounubility Report. 
Begin in 1996. 


4. For each academic program above, the 
average armual State appropriation per 
limited access grant recipient. 


OSFA provides data to 
PEPC. 


PEPC, in Accounubility 
Review. Begin in 1996. 
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EXAMPLE QUESTIONS FOR USE IN 
ACCOUNTABILITY-RELATED SITE VISITS 



(1) Is institutional improvement seen as the primary goal of the accountability process? To what extent 
is accountability process perceived as integral to institutional assessment and improvement, rather 
than as being an “add-on” data compilation and reporting exercise? 

(2) How are goals for institutional improvement set with regard to the accountability measures? 

(3) To what extent are the following groups involved in institution’s planning, assessment, data analy- 
sis, and feedback of results — administration, faculty, students, external constituents? 

(4) Who on campus receives copies of the accountability report? How is it used? 

(5) By what mechanism(s) are accountability data fed back into subsequent planning? How is institu- 
tional progress documented? How is progress communicated? 

(6) Have state-level entities with funding and policy-making authority to influence accountability pro- 
vided adequate policy guidance and fiscal support for accountability' expectations? 

(7) What measures are most appropriate to demonstrate institutional and systemwide performance 
with regard to state priorities for accountability? 

(8) With the advent of performance-based budgeting and other, more short-term, legislative account- 
ability-related initiatives, what is the role of accountability reporting as mandated in statute? 
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SAMPLE INDICATORS OF QUALITY IN UNDERGRADUATE EDUCATION 

A 1 995 Education Commission of the States report, Making Quality Count in Undergraduate Education, summa- 
rizes the results of focus group discussions involving political, business, and educational leaders to explore what 
quality in higher education means and how it can be measured. To virtually all parties from outside colleges and 
universities, quality resided less in institutional attributes than in student outcomes — attainments most visible after 
college in “what happens next.” Additionally, business and policy leaders generally were far more willing than 
college and university leaders to advocate straightforward and quantitative indicators of institutional performance. 

Participants were asked to offer suggestions about how quality should (or should not be) measured. All agreed the 
concept is complex and cannot be defined in terms of single comparative measures. Participants outlined several 
principles that should be used to guide any attempt to assess institutional quality. These principles include: ( 1 ) using 
multiple measures that profile quality along numerous dimensions; (2) using comparative measures across institu- 
tions with similar missions and operating conditions; (3) contextual data reporting; (4) presenting information about 
both absolute outcomes and the educational ‘Value added” by colleges and universities; (5) using external sources of 
information which provide another perspective and help ensure validity', such as ratings and perspectives of former 
students and employers; and (6) using mixed measures, qualitative and quantitative, to address both desired student 
outcomes and institutional attributes. 

Specific responses to the question, “What is quality undergraduate education?” clustered around two distinct themes. 
One addressed abilities and attributes of college graduates. The other embraced particular aspects of the collegiate 
experience and some specific ways in which colleges and universities, whatever their available resources, choose to 
“do their business.” An example of the kinds of indicators that might be included in a statewide accountability 
program under the rubric of “quality” appear below. 



1 . 

a. 



TYPES 
Individual Outcomes 
Completion 



b. Job Placement b. 

c. Further Education c. 



d. Skills Development 



d. 



2. Experiences 

a. Faculty Contact a. 



J 



3 . 



a. 



Insiruciional Experience 



b. 



Support Services 
Learning Suppoa a. 



SAMPLE INDICATOR 



DATA SOURCE 



% completing within X time, by 
demographic group. 

% placed in field, by program. 

% of 2-year starters obtaining 4- 
year aedemial (for 2-ycar 
institutions). 

% of employed former students 
repoaing that oral communication 
skills are important on the job and 
were enhanced by institution. 



a. unit record 

b. state wage data 

c. unit record 



d. survey 



Frequency of out of class faculty 
contact per week. 

Probability of at least one class 
< 15 as a freshman. 

Reported alumni/former student 
satisfaction with instruction 
provided. 



a. survey 

b. unit record 
survey 



% of new freshmen needing math a. 
remediation, by demographic group, 
and later success in college math. 



unit record 



b. Other Services 



b. % of students using/satisfied with 
spcuiLc support services. 



b. survey 



O 



Source: Making Quality Count in Undergraduate Education. 



Education Commission of the States ( 1 995). 



